Pandas Profiling Report

Dataset statistics

Number of variables	26
Number of observations	28318
Missing cells	195
Missing cells (%)	< 0.1%
Duplicate rows	399
Duplicate rows (%)	1.4%
Total size in memory	5.8 MiB
Average record size in memory	216.0 B

Variable types

CAT	12
NUM	10
DATE	2
BOOL	2

Warnings

Dataset has 399 (1.4%) duplicate rows	Duplicates
`first_name` has a high cardinality: 1176 distinct values	High cardinality
`last_name` has a high cardinality: 2722 distinct values	High cardinality
`allegation` has a high cardinality: 82 distinct values	High cardinality
`precinct_alpha` has a high cardinality: 80 distinct values	High cardinality
`year_received` is highly correlated with `complaint_id`	High correlation
`complaint_id` is highly correlated with `year_received`	High correlation
`allegation` is highly correlated with `fado_type`	High correlation
`fado_type` is highly correlated with `allegation`	High correlation
`complainant_age_incident` is highly skewed (γ1 = -124.0719749)	Skewed
`officer_cumcount` has 6779 (23.9%) zeros	Zeros

Reproduction

Analysis started	2020-11-30 00:21:27.709187
Analysis finished	2020-11-30 00:21:49.987933
Duration	22.28 seconds
Software version	pandas-profiling v2.9.0
Download configuration	config.yaml

first_name
Categorical

HIGH CARDINALITY

Distinct	1176
Distinct (%)	4.2%
Missing	0
Missing (%)	0.0%
Memory size	221.2 KiB

Michael	1431
Christophe	845
Joseph	769
John	717
Daniel	643
Other values (1171)	23913

Frequencies
Length

Common Values
Overview

Value	Count	Frequency (%)
Michael	1431	5.1%
Christophe	845	3.0%
Joseph	769	2.7%
John	717	2.5%
Daniel	643	2.3%
Robert	598	2.1%
Brian	531	1.9%
David	527	1.9%
James	526	1.9%
Thomas	463	1.6%
Other values (1166)	21268	75.1%

Frequencies of value counts

Unique

Unique	116 ?
Unique (%)	0.4%

Histogram of lengths of the category

Length

Max length	10
Median length	6
Mean length	5.985662829
Min length	2

last_name
Categorical

HIGH CARDINALITY

Distinct	2722
Distinct (%)	9.6%
Missing	0
Missing (%)	0.0%
Memory size	221.2 KiB

Rodriguez	259
Ortiz	171
Rivera	167
Martinez	153
Morales	139
Other values (2717)	27429

Frequencies
Length

Common Values
Overview

Value	Count	Frequency (%)
Rodriguez	259	0.9%
Ortiz	171	0.6%
Rivera	167	0.6%
Martinez	153	0.5%
Morales	139	0.5%
Perez	139	0.5%
Gonzalez	130	0.5%
Smith	127	0.4%
Martin	127	0.4%
Ramirez	118	0.4%
Other values (2712)	26788	94.6%

Frequencies of value counts

Unique

Unique	251 ?
Unique (%)	0.9%

Histogram of lengths of the category

Length

Max length	18
Median length	7
Mean length	6.65587259
Min length	2

complaint_id
Real number (ℝ_≥0)

HIGH CORRELATION

Distinct	10497
Distinct (%)	37.1%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	24810.71114
Minimum	3158
Maximum	43703
Zeros	0
Zeros (%)	0.0%
Memory size	221.2 KiB

Quantile statistics

Minimum	3158
5-th percentile	6564.75
Q1	15037
median	25794
Q3	34300.25
95-th percentile	41303
Maximum	43703
Range	40545
Interquartile range (IQR)	19263.25

Descriptive statistics

Standard deviation	11117.48166
Coefficient of variation (CV)	0.4480920195
Kurtosis	-1.182591997
Mean	24810.71114
Median Absolute Deviation (MAD)	9490.5
Skewness	-0.1615584346
Sum	702589718
Variance	123598398.4
Monotocity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
36901	30	0.1%
31072	20	0.1%
38927	20	0.1%
41986	19	0.1%
34557	19	0.1%
38071	18	0.1%
40678	18	0.1%
41779	18	0.1%
33162	18	0.1%
36313	17	0.1%
Other values (10487)	28121	99.3%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
3158	1	< 0.1%
3432	2	< 0.1%
3479	5	< 0.1%
3491	1	< 0.1%
3514	3	< 0.1%

Value	Count	Frequency (%)
43703	1	< 0.1%
43683	1	< 0.1%
43673	1	< 0.1%
43638	1	< 0.1%
43620	3	< 0.1%

month_received
Real number (ℝ_≥0)

Distinct	12
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	6.312451444
Minimum	1
Maximum	12
Zeros	0
Zeros (%)	0.0%
Memory size	221.2 KiB

Quantile statistics

Minimum	1
5-th percentile	1
Q1	3
median	6
Q3	9
95-th percentile	12
Maximum	12
Range	11
Interquartile range (IQR)	6

Descriptive statistics

Standard deviation	3.369308794
Coefficient of variation (CV)	0.5337559938
Kurtosis	-1.183763925
Mean	6.312451444
Median Absolute Deviation (MAD)	3
Skewness	0.05424331861
Sum	178756
Variance	11.35224175
Monotocity	Not monotonic

Histogram with fixed size bins (bins=12)

Value	Count	Frequency (%)
3	2731	9.6%
8	2553	9.0%
9	2522	8.9%
5	2522	8.9%
4	2426	8.6%
2	2402	8.5%
6	2350	8.3%
1	2324	8.2%
10	2289	8.1%
7	2268	8.0%
Other values (2)	3931	13.9%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
1	2324	8.2%
2	2402	8.5%
3	2731	9.6%
4	2426	8.6%
5	2522	8.9%

Value	Count	Frequency (%)
12	1892	6.7%
11	2039	7.2%
10	2289	8.1%
9	2522	8.9%
8	2553	9.0%

year_received
Real number (ℝ_≥0)

HIGH CORRELATION

Distinct	23
Distinct (%)	0.1%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	2011.446395
Minimum	1998
Maximum	2020
Zeros	0
Zeros (%)	0.0%
Memory size	221.2 KiB

Quantile statistics

Minimum	1998
5-th percentile	2003
Q1	2007
median	2012
Q3	2016
95-th percentile	2019
Maximum	2020
Range	22
Interquartile range (IQR)	9

Descriptive statistics

Standard deviation	4.91397957
Coefficient of variation (CV)	0.002443007968
Kurtosis	-0.8586098243
Mean	2011.446395
Median Absolute Deviation (MAD)	4
Skewness	-0.3110822189
Sum	56960139
Variance	24.14719521
Monotocity	Increasing

Histogram with fixed size bins (bins=23)

Value	Count	Frequency (%)
2015	2082	7.4%
2016	2021	7.1%
2014	1970	7.0%
2018	1935	6.8%
2013	1934	6.8%
2017	1838	6.5%
2007	1736	6.1%
2011	1728	6.1%
2012	1705	6.0%
2009	1605	5.7%
Other values (13)	9764	34.5%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
1998	19	0.1%
1999	84	0.3%
2000	195	0.7%
2001	302	1.1%
2002	488	1.7%

Value	Count	Frequency (%)
2020	2	< 0.1%
2019	1427	5.0%
2018	1935	6.8%
2017	1838	6.5%
2016	2021	7.1%

mos_ethnicity
Categorical

Distinct	5
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Memory size	221.2 KiB

White	15000
Hispanic	8033
Black	4223
Asian	1037
American Indian	25

Frequencies
Length

Value	Count	Frequency (%)
White	15000	53.0%
Hispanic	8033	28.4%
Black	4223	14.9%
Asian	1037	3.7%
American Indian	25	0.1%

Frequencies of value counts

Unique

Unique	0 ?
Unique (%)	0.0%

Histogram of lengths of the category

Length

Max length	15
Median length	5
Mean length	5.859841797
Min length	5

mos_gender
Categorical

Distinct	2
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Memory size	221.2 KiB

M	26768
F	1550

Frequencies
Length

Value	Count	Frequency (%)
M	26768	94.5%
F	1550	5.5%

Frequencies of value counts

Unique

Unique	0 ?
Unique (%)	0.0%

Histogram of lengths of the category

Length

Max length	1
Median length	1
Mean length	1
Min length	1

mos_age_incident
Real number (ℝ_≥0)

Distinct	39
Distinct (%)	0.1%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	32.41507169
Minimum	21
Maximum	60
Zeros	0
Zeros (%)	0.0%
Memory size	221.2 KiB

Quantile statistics

Minimum	21
5-th percentile	24
Q1	28
median	32
Q3	36
95-th percentile	44
Maximum	60
Range	39
Interquartile range (IQR)	8

Descriptive statistics

Standard deviation	5.973311314
Coefficient of variation (CV)	0.1842757397
Kurtosis	0.2748606286
Mean	32.41507169
Median Absolute Deviation (MAD)	4
Skewness	0.7187605364
Sum	917930
Variance	35.68044805
Monotocity	Not monotonic

Histogram with fixed size bins (bins=39)

Value	Count	Frequency (%)
30	2051	7.2%
28	1935	6.8%
31	1900	6.7%
29	1867	6.6%
32	1781	6.3%
27	1780	6.3%
33	1704	6.0%
35	1519	5.4%
34	1491	5.3%
26	1486	5.2%
Other values (29)	10804	38.2%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
21	16	0.1%
22	205	0.7%
23	470	1.7%
24	995	3.5%
25	1386	4.9%

Value	Count	Frequency (%)
60	2	< 0.1%
58	6	< 0.1%
57	5	< 0.1%
56	5	< 0.1%
55	4	< 0.1%

complainant_ethnicity
Categorical

Distinct	6
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Memory size	221.2 KiB

Black	16886
Hispanic	6332
White	2749
Other	1762
Asian	525

Frequencies
Length

Value	Count	Frequency (%)
Black	16886	59.6%
Hispanic	6332	22.4%
White	2749	9.7%
Other	1762	6.2%
Asian	525	1.9%
American Indian	64	0.2%

Frequencies of value counts

Unique

Unique	0 ?
Unique (%)	0.0%

Histogram of lengths of the category

Length

Max length	15
Median length	5
Mean length	5.693410552
Min length	5

complainant_gender
Categorical

Distinct	3
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Memory size	221.2 KiB

Male	23409
Female	4849
Other	60

Frequencies
Length

Value	Count	Frequency (%)
Male	23409	82.7%
Female	4849	17.1%
Other	60	0.2%

Frequencies of value counts

Unique

Unique	0 ?
Unique (%)	0.0%

Histogram of lengths of the category

Length

Max length	6
Median length	4
Mean length	4.344586482
Min length	4

complainant_age_incident
Real number (ℝ)

SKEWED

Distinct	87
Distinct (%)	0.3%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	32.50847517
Minimum	-4301
Maximum	101
Zeros	2
Zeros (%)	< 0.1%
Memory size	221.2 KiB

Quantile statistics

Minimum	-4301
5-th percentile	17
Q1	23
median	30
Q3	41
95-th percentile	55
Maximum	101
Range	4402
Interquartile range (IQR)	18

Descriptive statistics

Standard deviation	28.50157375
Coefficient of variation (CV)	0.8767428678
Kurtosis	18873.89805
Mean	32.50847517
Median Absolute Deviation (MAD)	8
Skewness	-124.0719749
Sum	920575
Variance	812.3397064
Monotocity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
26	1145	4.0%
24	1118	3.9%
30	1047	3.7%
23	1020	3.6%
25	1005	3.5%
21	945	3.3%
28	943	3.3%
27	933	3.3%
22	925	3.3%
29	906	3.2%
Other values (77)	18331	64.7%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
-4301	1	< 0.1%
-1	5	< 0.1%
0	2	< 0.1%
1	1	< 0.1%
2	1	< 0.1%

Value	Count	Frequency (%)
101	2	< 0.1%
88	1	< 0.1%
87	4	< 0.1%
86	2	< 0.1%
84	1	< 0.1%

fado_type
Categorical

HIGH CORRELATION

Distinct	4
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Memory size	221.2 KiB

Abuse of Authority	16850
Force	6685
Discourtesy	4147
Offensive Language	636

Frequencies
Length

Value	Count	Frequency (%)
Abuse of Authority	16850	59.5%
Force	6685	23.6%
Discourtesy	4147	14.6%
Offensive Language	636	2.2%

Frequencies of value counts

Unique

Unique	0 ?
Unique (%)	0.0%

Histogram of lengths of the category

Length

Max length	18
Median length	18
Mean length	13.90599619
Min length	5

allegation
Categorical

HIGH CARDINALITY
HIGH CORRELATION

Distinct	82
Distinct (%)	0.3%
Missing	0
Missing (%)	0.0%
Memory size	221.2 KiB

Physical force	4673
Word	3747
Stop	2181
Search (of person)	1928
Frisk	1763
Other values (77)	14026

Frequencies
Length

Common Values
Overview

Value	Count	Frequency (%)
Physical force	4673	16.5%
Word	3747	13.2%
Stop	2181	7.7%
Search (of person)	1928	6.8%
Frisk	1763	6.2%
Refusal to provide name/shield number	1452	5.1%
Vehicle search	1370	4.8%
Threat of arrest	1289	4.6%
Vehicle stop	1067	3.8%
Threat of force (verbal or physical)	867	3.1%
Other values (72)	7981	28.2%

Frequencies of value counts

Unique

Unique	5 ?
Unique (%)	< 0.1%

Histogram of lengths of the category

Length

Max length	40
Median length	14
Mean length	14.39526096
Min length	4

precinct
Real number (ℝ_≥0)

Distinct	79
Distinct (%)	0.3%
Missing	19
Missing (%)	0.1%
Infinite	0
Infinite (%)	0.0%

Mean	64.22739319
Minimum	0
Maximum	1000
Zeros	2
Zeros (%)	< 0.1%
Memory size	221.2 KiB

Quantile statistics

Minimum	0
5-th percentile	14
Q1	42
median	67
Q3	81
95-th percentile	115
Maximum	1000
Range	1000
Interquartile range (IQR)	39

Descriptive statistics

Standard deviation	31.85861193
Coefficient of variation (CV)	0.4960284133
Kurtosis	77.76226724
Mean	64.22739319
Median Absolute Deviation (MAD)	23
Skewness	2.778484333
Sum	1817571
Variance	1014.971154
Monotocity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
75	1784	6.3%
73	1001	3.5%
44	991	3.5%
79	950	3.4%
46	942	3.3%
67	906	3.2%
40	897	3.2%
47	781	2.8%
77	774	2.7%
120	747	2.6%
Other values (69)	18526	65.4%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	2	< 0.1%
1	162	0.6%
5	153	0.5%
6	158	0.6%
7	180	0.6%

Value	Count	Frequency (%)
1000	3	< 0.1%
123	98	0.3%
122	206	0.7%
121	340	1.2%
120	747	2.6%

contact_reason
Categorical

Distinct	13
Distinct (%)	< 0.1%
Missing	128
Missing (%)	0.5%
Memory size	221.2 KiB

PD suspected C/V of violation/crime - street	9459
Other	6687
PD suspected C/V of violation/crime - auto	2837
PD suspected C/V of violation/crime - bldg	2121
Moving violation	1927
Other values (8)	5159

Frequencies
Length

Common Values
Overview

Value	Count	Frequency (%)
PD suspected C/V of violation/crime - street	9459	33.4%
Other	6687	23.6%
PD suspected C/V of violation/crime - auto	2837	10.0%
PD suspected C/V of violation/crime - bldg	2121	7.5%
Moving violation	1927	6.8%
Other violation of VTL	1090	3.8%
Report-dispute	923	3.3%
Report of other crime	722	2.5%
Parking violation	603	2.1%
Execution of search warrant	500	1.8%
Other values (3)	1321	4.7%

Frequencies of value counts

Unique

Unique	0 ?
Unique (%)	0.0%

Histogram of lengths of the category

Length

Max length	58
Median length	42
Mean length	28.8152765
Min length	3

outcome_description
Categorical

Distinct	4
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Memory size	221.2 KiB

Arrest	12607
None	10265
Summons	5348
Other	98

Frequencies
Length

Value	Count	Frequency (%)
Arrest	12607	44.5%
None	10265	36.2%
Summons	5348	18.9%
Other	98	0.3%

Frequencies of value counts

Unique

Unique	0 ?
Unique (%)	0.0%

Histogram of lengths of the category

Length

Max length	7
Median length	6
Mean length	5.460413871
Min length	4

disposition_clean
Categorical

Distinct	3
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Memory size	221.2 KiB

Unsubstantiated	13590
Exonerated	7748
Substantiated	6980

Frequencies
Length

Value	Count	Frequency (%)
Unsubstantiated	13590	48.0%
Exonerated	7748	27.4%
Substantiated	6980	24.6%

Frequencies of value counts

Unique

Unique	0 ?
Unique (%)	0.0%

Histogram of lengths of the category

Length

Max length	15
Median length	13
Mean length	13.13899287
Min length	10

ruling_conduct_occurred
Boolean

Distinct	2
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Memory size	221.2 KiB

1	14728
0	13590

Common Values
Chart

Value	Count	Frequency (%)
1	14728	52.0%
0	13590	48.0%

ruling_conduct_violated_rules
Boolean

Distinct	2
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Memory size	221.2 KiB

0	21338
1	6980

Common Values
Chart

Value	Count	Frequency (%)
0	21338	75.4%
1	6980	24.6%

received_datetime
Date

Distinct	257
Distinct (%)	0.9%
Missing	0
Missing (%)	0.0%
Memory size	221.2 KiB

Minimum	1998-03-01 00:00:00
Maximum	2020-01-01 00:00:00

Histogram

Histogram with fixed size bins (bins=50)

closed_datetime
Date

Distinct	240
Distinct (%)	0.8%
Missing	0
Missing (%)	0.0%
Memory size	221.2 KiB

Minimum	2000-03-01 00:00:00
Maximum	2020-06-01 00:00:00

Histogram

Histogram with fixed size bins (bins=50)

officer_cumcount
Real number (ℝ_≥0)

ZEROS

Distinct	29
Distinct (%)	0.1%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	2.873543329
Minimum	0
Maximum	28
Zeros	6779
Zeros (%)	23.9%
Memory size	221.2 KiB

Quantile statistics

Minimum	0
5-th percentile	0
Q1	1
median	2
Q3	4
95-th percentile	9
Maximum	28
Range	28
Interquartile range (IQR)	3

Descriptive statistics

Standard deviation	3.269607464
Coefficient of variation (CV)	1.137831273
Kurtosis	5.751913661
Mean	2.873543329
Median Absolute Deviation (MAD)	2
Skewness	2.020516489
Sum	81373
Variance	10.69033297
Monotocity	Not monotonic

Histogram with fixed size bins (bins=29)

Value	Count	Frequency (%)
0	6779	23.9%
1	5601	19.8%
2	4344	15.3%
3	3073	10.9%
4	2310	8.2%
5	1648	5.8%
6	1174	4.1%
7	953	3.4%
8	608	2.1%
9	484	1.7%
Other values (19)	1344	4.7%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	6779	23.9%
1	5601	19.8%
2	4344	15.3%
3	3073	10.9%
4	2310	8.2%

Value	Count	Frequency (%)
28	2	< 0.1%
27	2	< 0.1%
26	3	< 0.1%
25	4	< 0.1%
24	7	< 0.1%

command_rank_num
Real number (ℝ_≥0)

Distinct	7
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	1.594462886
Minimum	1
Maximum	7
Zeros	0
Zeros (%)	0.0%
Memory size	221.2 KiB

Quantile statistics

Minimum	1
5-th percentile	1
Q1	1
median	1
Q3	2
95-th percentile	3
Maximum	7
Range	6
Interquartile range (IQR)	1

Descriptive statistics

Standard deviation	0.9690046128
Coefficient of variation (CV)	0.6077310557
Kurtosis	1.484993552
Mean	1.594462886
Median Absolute Deviation (MAD)	0
Skewness	1.476812369
Sum	45152
Variance	0.9389699396
Monotocity	Not monotonic

Histogram with fixed size bins (bins=7)

Value	Count	Frequency (%)
1	19350	68.3%
3	5011	17.7%
2	2690	9.5%
4	1051	3.7%
5	112	0.4%
6	103	0.4%
7	1	< 0.1%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
1	19350	68.3%
2	2690	9.5%
3	5011	17.7%
4	1051	3.7%
5	112	0.4%

Value	Count	Frequency (%)
7	1	< 0.1%
6	103	0.4%
5	112	0.4%
4	1051	3.7%
3	5011	17.7%

precinct_alpha
Categorical

HIGH CARDINALITY

Distinct	80
Distinct (%)	0.3%
Missing	0
Missing (%)	0.0%
Memory size	221.2 KiB

P_75	1784
P_73	1001
P_44	991
P_79	950
P_46	942
Other values (75)	22650

Frequencies
Length

Common Values
Overview

Value	Count	Frequency (%)
P_75	1784	6.3%
P_73	1001	3.5%
P_44	991	3.5%
P_79	950	3.4%
P_46	942	3.3%
P_67	906	3.2%
P_40	897	3.2%
P_47	781	2.8%
P_77	774	2.7%
P_120	747	2.6%
Other values (70)	18545	65.5%

Frequencies of value counts

Unique

Unique	0 ?
Unique (%)	0.0%

Histogram of lengths of the category

Length

Max length	6
Median length	4
Mean length	4.158344516
Min length	3

percent_unemployed_mean
Real number (ℝ_≥0)

Distinct	77
Distinct (%)	0.3%
Missing	24
Missing (%)	0.1%
Infinite	0
Infinite (%)	0.0%

Mean	11.67381508
Minimum	3.494837819
Maximum	100
Zeros	0
Zeros (%)	0.0%
Memory size	221.2 KiB

Quantile statistics

Minimum	3.494837819
5-th percentile	5.520730327
Q1	8.624282869
median	11.50349865
Q3	14.01450408
95-th percentile	16.74778723
Maximum	100
Range	96.50516218
Interquartile range (IQR)	5.390221206

Descriptive statistics

Standard deviation	4.473285897
Coefficient of variation (CV)	0.3831897169
Kurtosis	65.80121731
Mean	11.67381508
Median Absolute Deviation (MAD)	2.818408816
Skewness	3.966154767
Sum	330298.9239
Variance	20.01028671
Monotocity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
11.50349865	1784	6.3%
14.01450408	1001	3.5%
14.32190747	991	3.5%
12.02291135	950	3.4%
14.72345318	942	3.3%
10.45392058	906	3.2%
16.68495503	897	3.2%
13.38018254	781	2.8%
10.08980936	774	2.7%
7.697731881	747	2.6%
Other values (67)	18521	65.4%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
3.494837819	162	0.6%
3.65637147	128	0.5%
3.938528102	78	0.3%
4.170625555	297	1.0%
4.30000613	218	0.8%

Value	Count	Frequency (%)
100	12	< 0.1%
28.73937932	458	1.6%
19.26141245	554	2.0%
16.74778723	598	2.1%
16.68495503	897	3.2%

percent_nohs_mean
Real number (ℝ_≥0)

Distinct	77
Distinct (%)	0.3%
Missing	24
Missing (%)	0.1%
Infinite	0
Infinite (%)	0.0%

Mean	22.23330075
Minimum	1.011353087
Maximum	50
Zeros	0
Zeros (%)	0.0%
Memory size	221.2 KiB

Quantile statistics

Minimum	1.011353087
5-th percentile	6.667612475
Q1	14.99169451
median	21.00517081
Q3	27.92354956
95-th percentile	38.57440058
Maximum	50
Range	48.98864691
Interquartile range (IQR)	12.93185505

Descriptive statistics

Standard deviation	9.273705232
Coefficient of variation (CV)	0.4171087926
Kurtosis	-0.5502450903
Mean	22.23330075
Median Absolute Deviation (MAD)	6.013476308
Skewness	0.1135490422
Sum	629069.0115
Variance	86.00160874
Monotocity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
22.76309638	1784	6.3%
25.98968475	1001	3.5%
35.54436613	991	3.5%
19.93781475	950	3.4%
34.14999287	942	3.3%
14.99169451	906	3.2%
38.57440058	897	3.2%
19.54024741	781	2.8%
16.84406406	774	2.7%
13.00994332	747	2.6%
Other values (67)	18521	65.4%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
1.011353087	158	0.6%
1.933804875	70	0.2%
2.225137478	128	0.5%
2.745617033	78	0.3%
2.819734132	162	0.6%

Value	Count	Frequency (%)
50	12	< 0.1%
41.6235739	458	1.6%
39.15684139	554	2.0%
38.57440058	897	3.2%
35.89699247	567	2.0%

Pearson's r

The Pearson's correlation coefficient (r) is a measure of linear correlation between two variables. It's value lies between -1 and +1, -1 indicating total negative linear correlation, 0 indicating no linear correlation and 1 indicating total positive linear correlation. Furthermore, r is invariant under separate changes in location and scale of the two variables, implying that for a linear function the angle to the x-axis does not affect r.

To calculate r for two variables X and Y, one divides the covariance of X and Y by the product of their standard deviations.

Spearman's ρ

The Spearman's rank correlation coefficient (ρ) is a measure of monotonic correlation between two variables, and is therefore better in catching nonlinear monotonic correlations than Pearson's r. It's value lies between -1 and +1, -1 indicating total negative monotonic correlation, 0 indicating no monotonic correlation and 1 indicating total positive monotonic correlation.

To calculate ρ for two variables X and Y, one divides the covariance of the rank variables of X and Y by the product of their standard deviations.

Kendall's τ

Similarly to Spearman's rank correlation coefficient, the Kendall rank correlation coefficient (τ) measures ordinal association between two variables. It's value lies between -1 and +1, -1 indicating total negative correlation, 0 indicating no correlation and 1 indicating total positive correlation.

To calculate τ for two variables X and Y, one determines the number of concordant and discordant pairs of observations. τ is given by the number of concordant pairs minus the discordant pairs divided by the total number of pairs.

Phik (φk)

Phik (φk) is a new and practical correlation coefficient that works consistently between categorical, ordinal and interval variables, captures non-linear dependency and reverts to the Pearson correlation coefficient in case of a bivariate normal input distribution. There is extensive documentation available here.

Cramér's V (φc)

Cramér's V is an association measure for nominal random variables. The coefficient ranges from 0 to 1, with 0 indicating independence and 1 indicating perfect association. The empirical estimators used for Cramér's V have been proved to be biased, even for large samples. We use a bias-corrected measure that has been proposed by Bergsma in 2013 that can be found here.

First rows

	first_name	last_name	complaint_id	month_received	year_received	mos_ethnicity	mos_gender	mos_age_incident	complainant_ethnicity	complainant_gender	complainant_age_incident	fado_type	allegation	precinct	contact_reason	outcome_description	disposition_clean	ruling_conduct_occurred	ruling_conduct_violated_rules	received_datetime	closed_datetime	officer_cumcount	command_rank_num	precinct_alpha	percent_unemployed_mean	percent_nohs_mean
0	Kenneth	Cullen	3158	3	1998	White	M	28	Black	Male	20.0	Force	Gun Fired	79.0	PD suspected C/V of violation/crime - bldg	Arrest	Exonerated	1	0	1998-03-01	2000-08-01	1	3	P_79	12.022911	19.937815
1	Michael	Vento	3432	10	1998	White	M	32	Black	Male	32.0	Force	Physical force	40.0	C/V intervened on behalf of/observed encounter w/3rd party	Arrest	Unsubstantiated	0	0	1998-10-01	2000-05-01	0	1	P_40	16.684955	38.574401
2	Michael	Vento	3432	10	1998	White	M	32	Black	Male	32.0	Abuse of Authority	Frisk and/or search	40.0	C/V intervened on behalf of/observed encounter w/3rd party	Arrest	Unsubstantiated	0	0	1998-10-01	2000-05-01	0	1	P_40	16.684955	38.574401
3	Michael	Cronin	3479	11	1998	White	M	30	Black	Male	47.0	Force	Punch/Kick	46.0	NaN	None	Unsubstantiated	0	0	1998-11-01	2000-06-01	1	2	P_46	14.723453	34.149993
4	Michael	Cronin	3479	11	1998	White	M	30	Black	Male	47.0	Abuse of Authority	Frisk and/or search	46.0	NaN	None	Exonerated	1	0	1998-11-01	2000-06-01	1	2	P_46	14.723453	34.149993
5	Michael	Cronin	3479	11	1998	White	M	30	Black	Male	47.0	Abuse of Authority	Person Searched	46.0	NaN	None	Unsubstantiated	0	0	1998-11-01	2000-06-01	1	2	P_46	14.723453	34.149993
6	Michael	Cronin	3479	11	1998	White	M	30	Black	Male	47.0	Discourtesy	Word	46.0	NaN	None	Unsubstantiated	0	0	1998-11-01	2000-06-01	1	2	P_46	14.723453	34.149993
7	Michael	Cronin	3479	11	1998	White	M	30	Black	Male	47.0	Abuse of Authority	Refusal to provide name/shield number	46.0	NaN	None	Substantiated	1	1	1998-11-01	2000-06-01	1	2	P_46	14.723453	34.149993
8	Eric	Single	3491	11	1998	White	M	29	Black	Male	33.0	Force	Other	115.0	NaN	None	Unsubstantiated	0	0	1998-11-01	2000-04-01	2	1	P_115	7.829801	26.733794
9	George	Sullivan	3514	12	1998	White	M	28	Black	Male	14.0	Force	Physical force	72.0	NaN	None	Exonerated	1	0	1998-12-01	2000-04-01	0	1	P_72	8.062203	32.570689

Last rows

	first_name	last_name	complaint_id	month_received	year_received	mos_ethnicity	mos_gender	mos_age_incident	complainant_ethnicity	complainant_gender	complainant_age_incident	fado_type	allegation	precinct	contact_reason	outcome_description	disposition_clean	ruling_conduct_occurred	ruling_conduct_violated_rules	received_datetime	closed_datetime	officer_cumcount	command_rank_num	precinct_alpha	percent_unemployed_mean	percent_nohs_mean
28308	Damon	Martin	43619	12	2019	Black	M	45	Black	Female	59.0	Abuse of Authority	Search of Premises	75.0	Execution of search warrant	Summons	Exonerated	1	0	2019-12-01	2020-04-01	18	3	P_75	11.503499	22.763096
28309	Damon	Martin	43619	12	2019	Black	M	45	Black	Female	59.0	Abuse of Authority	Entry of Premises	75.0	Execution of search warrant	Summons	Exonerated	1	0	2019-12-01	2020-04-01	18	3	P_75	11.503499	22.763096
28310	Charles	Powell	43592	12	2019	Black	M	32	Black	Male	65.0	Discourtesy	Action	14.0	Other	Summons	Substantiated	1	1	2019-12-01	2020-05-01	1	1	P_14	4.170626	6.667612
28311	Charles	Powell	43592	12	2019	Black	M	32	Black	Male	65.0	Discourtesy	Action	14.0	Other	Summons	Substantiated	1	1	2019-12-01	2020-05-01	1	1	P_14	4.170626	6.667612
28312	David	Ramirez	43605	12	2019	Hispanic	M	26	Black	Male	43.0	Offensive Language	Race	48.0	Report of other crime	None	Unsubstantiated	0	0	2019-12-01	2020-05-01	4	1	P_48	19.261412	39.156841
28313	David	Ramirez	43605	12	2019	Hispanic	M	26	Black	Male	43.0	Abuse of Authority	Threat to damage/seize property	48.0	Report of other crime	None	Unsubstantiated	0	0	2019-12-01	2020-05-01	4	1	P_48	19.261412	39.156841
28314	Anthony	Jones	43638	12	2019	Black	M	41	Asian	Male	35.0	Abuse of Authority	Threat of arrest	18.0	Moving violation	Summons	Exonerated	1	0	2019-12-01	2020-04-01	1	1	P_18	4.300006	5.275617
28315	Timothy	Sprague	43673	12	2019	White	M	32	Black	Female	42.0	Abuse of Authority	Threat of arrest	24.0	Report of other crime	Arrest	Exonerated	1	0	2019-12-01	2020-06-01	1	3	P_24	7.257308	10.047435
28316	Robert	Obrien	43683	1	2020	White	M	35	Black	Female	56.0	Abuse of Authority	Property damaged	79.0	Execution of search warrant	None	Exonerated	1	0	2020-01-01	2020-05-01	3	1	P_79	12.022911	19.937815
28317	Brendan	Dono	43703	1	2020	White	M	39	Hispanic	Male	42.0	Abuse of Authority	Vehicle search	10.0	Other violation of VTL	Summons	Exonerated	1	0	2020-01-01	2020-06-01	9	1	P_10	7.088728	5.732158

Most frequent

	first_name	last_name	complaint_id	month_received	year_received	mos_ethnicity	mos_gender	mos_age_incident	complainant_ethnicity	complainant_gender	complainant_age_incident	fado_type	allegation	precinct	contact_reason	outcome_description	disposition_clean	ruling_conduct_occurred	ruling_conduct_violated_rules	received_datetime	closed_datetime	officer_cumcount	command_rank_num	precinct_alpha	percent_unemployed_mean	percent_nohs_mean	count
159	John	Parente	38526	12	2017	White	M	36	Black	Male	31.0	Force	Nonlethal restraining device	79.0	PD suspected C/V of violation/crime - street	Arrest	Exonerated	1	0	2017-12-01	2019-11-01	7	3	P_79	12.022911	19.937815	5
267	Miroslav	Maric	37123	5	2017	White	M	35	Hispanic	Male	37.0	Discourtesy	Word	44.0	PD suspected C/V of violation/crime - auto	Arrest	Unsubstantiated	0	0	2017-05-01	2017-10-01	3	3	P_44	14.321907	35.544366	5
352	Troy	Peacock	42099	4	2019	Black	M	36	Asian	Male	27.0	Force	Nonlethal restraining device	73.0	Other	None	Exonerated	1	0	2019-04-01	2020-05-01	6	3	P_73	14.014504	25.989685	5
3	Alejandro	Valderrama	34658	3	2016	Hispanic	M	28	Black	Male	33.0	Force	Physical force	77.0	PD suspected C/V of violation/crime - street	Arrest	Unsubstantiated	0	0	2016-03-01	2016-09-01	4	1	P_77	10.089809	16.844064	4
9	Ananda	Mirandamessner	39086	3	2018	Hispanic	F	29	White	Female	65.0	Force	Physical force	60.0	Report-domestic dispute	Arrest	Unsubstantiated	0	0	2018-03-01	2019-05-01	2	1	P_60	10.037453	20.593446	3
36	Brian	Latva	35063	5	2016	White	M	32	Black	Female	17.0	Force	Nonlethal restraining device	106.0	Other	Arrest	Substantiated	1	1	2016-05-01	2016-11-01	0	3	P_106	9.723378	21.118369	3
48	Christian	Cayenne	37644	7	2017	Black	M	25	Black	Male	23.0	Abuse of Authority	Threat of force (verbal or physical)	72.0	Other	None	Unsubstantiated	0	0	2017-07-01	2018-03-01	2	1	P_72	8.062203	32.570689	3
53	Christophe	Aylward	36714	3	2017	White	M	36	Other	Male	26.0	Force	Physical force	105.0	Other	None	Exonerated	1	0	2017-03-01	2017-10-01	0	1	P_105	8.560916	13.302691	3
64	Christophe	Sanchez	35299	6	2016	White	M	29	Hispanic	Male	24.0	Force	Other	110.0	PD suspected C/V of violation/crime - street	Arrest	Unsubstantiated	0	0	2016-06-01	2017-02-01	2	1	P_110	6.096214	32.422545	3
98	Edward	Mcclain	40162	8	2018	White	M	34	Black	Male	44.0	Discourtesy	Word	44.0	PD suspected C/V of violation/crime - street	Summons	Unsubstantiated	0	0	2018-08-01	2019-06-01	3	1	P_44	14.321907	35.544366	3

Overview

Variables

Interactions

Correlations

Pearson's r

Spearman's ρ

Kendall's τ

Phik (φk)

Cramér's V (φc)

Missing values

Sample

First rows

Last rows

Duplicate rows

Most frequent